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THE TRAMSFER FROM MODALITY PERCEPTDiyL 
TO MODALITY CONCEPTUAI;* 



by 



Alex Bannatyne 



This topic if thoroughly examined would fill several thick 
volumes, even with the present state of limited knowledge pos- 
sessed by psychologists, neurologists, linguists and educators. 

Therefore the most I can hope to do in this paper is to Indicate 
• • • ^ 



♦ Paper read at the International Reading Association Annual 
Convention, Seattle, Washington, May, 1967. 
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to teachers and clinicians that there is more to reading than, 
shall I say, meets the eye. Current work in the area of language 
in neurology, linguistics and psychology all seems to point to 
at least three (and probably many more) levels or areas of func- 
tioning. 

THE SENSORY LEVEL 

Tlie first »»level*» is the sensory and it includes hearing, 
seeing, movement sensing, touch etc, as well as the primary areas 
of the cortex where the sensory signals are first received and - 
from the sensation aspect only - identified as having primary 
physical attributes, e.g., shapes, noises, colors, bulk. How- 
ever there is no recognition and still less understanding on 
this level. Neurological ly this sensory input is very likely 
decoded in this simple way in both the sense organs themselves 
and their respective primary cortical areas. These functions, 
which operate well even in babies, must obviously be intact if 
a child is going to learn to read in the usual way yet many 
learning disability cases with primary neuro-sensory deficits 
remain undiagnosed, and I do not refer merely to the hard-of- 
hearing or partially sighted. By the time a child comes to 

i 

learn to read he has usually ac<iuired a fully working auditory/ 
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vocal language and so all he has to do is associate a visual 
code with this auditory /vocal code . However many learning 
disability cases do not have a competent sudiLory/vocal lan- 
guage and so before examining this audio-visual linkage I would 
like to discuss the way in which auditory/vocal codes become 
associated with meaning. To do this I would prefer to not use 
the ambiguous term **word” but substitute for it "sound -label” 
(and later on, "visual-label"). These terms are, respectively, 
shorthand for the spoken or heard word and for the read or 
printed word, the latter representing the succession of phon- 
emes which comprise the former. 



THE PERCEPTUAL LEVEL 



Much of the experience most people have throughout their 
lives is non-verbal even when verbal activity is going on con- 
incidentally. We drive the car, watch television, listen to 
music, play sport and so on. This direct experiential material 
is built up some of it selectively from birth coming in through 
the body and its senses into a main memory store which seems to 
cooperate with other cognitive processes to cross index, super- 



impose and freely associate the received "Images" into concepts 

a 

or meanings. Thus when we see /particular chair we classify it 



non-verbally as one of those single-seated pieces of furniture 
in which one adopts a specific relaxed posture. A non-verbal 
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infant could conceivably not be acquainted with the sound- 
label "chair" yet know its function . Thus perception combines 
'indentif ied* sensory input data with meaning or concept, the 
latter being a function of utilitarian attention or other 
su'vlval -value experience. Neurological ly it is possible that 
this perceived meaningful material may in terms of memory be 
stored in what Penfleld and Roberts (1959) call the "inter- 
pretive cortex". They say, *Tsychical responses may be called 
experiential or interpretive. They have been obtained ... 
only from certain portions of the temporal lobe cortex in 
either hemisphere". Much of this experiential or perceptual 
memory bank is non-verbal in the strict linguistic sense. The 
unit of perception then, as an internalised composite of mean- 
ingful Images, is termed a concept. More correctly, a percept 
is one type of concept namely one which Involves an immediate 
sensing of the environment. 

THE CONCEPTUAL LEVEL 

A concept can be defined as an enduring (and most likely 
progressing) coalescence of related Images usually in the form 
of a class (e.g., government, table, furniture). Whereas a 
percept must always Involve an immediate meaningful inter- 
pretation of the environment a concept may be manipulated 
internally without reference to the Immediate non-verbal phys- 
ical environment. If we ponder on a mental arithmetic problen 
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or next year's vacation we are thinking » that Is manipulating 
concepts Internally* Thought processes may take place with or 
without continuous or Intermlttant non"’verbal percepts* A 
watchmaker repairing a watch resolves the problem (on the basis 
of previous experience -built concepts) under circumstances of 
acute visual perception* Conceptualizing (thinking) usually 
Includes some form of reasoning, a process which involves the 
manipulation of the relationships between separate image-type 
concepts, (e.g*. If I put the chair on the table I will be able 
to replace the broken electric light fitting)* 

SYMBOLS 

A symbol can be defined as an "object” or "thing" which, 
being indelibly associated In the mind with another "object" 
or "thing" serves as a recall agent for the latter* A flag 
can symbolise national identity and spoken words can symbolise 
almost anythiiB* The important point is that the symbolic- 
object is, in its own right, also a primary object which is 
sensed, perceived and conceptualised* T'^Ihen these symbolic objects 
are verbal labels (symbols) of various types we call the percepts, 
concepts and relationship reasonings which they represent a 
spoken language. Obviously the purpose of symbolic systems 
such as spoken language is to enable us to communicate with 
each other, or to reason without having to manipulate real 
objects directly* Instead of showing people how to put the 
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chair on the table to get to the broken li^t I can tell 
them using sound-label substitutes* Thus the spoken word may 
facilitate conceptualizing but Is not itself conceptualizing. 

Still less is verbal activity equatable with abstractions which 
Is a higher order conceptualizing process frequently vlsuo- 
spatlal in modality, as for example in abstract art. 

In the written form of languages we have a system of sec- 
ondary (visual) symbols which represent the primary (auditory- 
vocal) symbols which in their turn represent the perceived 
objects or coalesced concepts* These secondary (visual) 
symbols are also objects in their own right which are directly 
sensed, perceived and conceptualized Just as are both the primary 
auditory symbols and the original objects. Therefore a written 
phonetic language expresses a sensory, perceptual and conceptual 
system, the latter two being capable of symbolic expression 

through two symbolic systems. 

The way in which the psychological imagery processes are 
cross-related with the two symbol systems is presented in some 
detail In the following table. 
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SYMBOL SYSTEMS 

If the above table is examined carefully it is largely 
self-explanatory. As one moves down the imagery or symbol 
system columns their content, the vertical developmental proces- 
ses and the horizontal association processes become increas- 
ingly complex - which is not surprising since the transition 
from the top left hand sense-data corner to the lower right- 
hand reading/reasoning corner parallels the likely psychological 

evolution of the human organism. 

The developmental progression although it may sometimes 
appear to operate on a continuum from sensing to thought prob- 
ably does not do so. It is highly likely (and at the sensory 
level fairly certain) that specific areas of the brain may take 
care of each psychological function, namely sensing, memorising 
(as an aspect of perceiving and simple conceptualising) and 
thinking (Penfield and Roberts, 1959 and Itountcastle, 1962). 

It is also probable that the two symbol systems being of sensory 
origin also each have their specific neurological territory. 

And it is not a contradiction of the foregoing statements to 
say that all these neurological facets of the brain overlap 
and interlock in unbelievably intricate inter-communication 
systems. Psychologically these are the association, control 
and feed-back processes through which the functioning of the 
parts is integrated. Of course the higher functions, together 
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with the complex symbolic labelling and sequencing they involve, 
usually incorporate all the lower levels in their operation* 

Even so one can obviously think in the absence of immediate 
sensory stimuli* 

The childhood development of conceptual imagery and thinking 
has been investigated by many people notably Piaget* The work 
of the "symbolic" logicians is also relevant to the laws and 
rules of human thought* However although Osgood, Uepman, Kirk 
and others have constructed excellent models for the hier- 
archical classification of language and conceptualizing processes, 
until recently no clear theoretical distinctions had been 
made between imagery/concepts and the tx>70 symbol systems* 

Osgood (1963) has analysed the relationship between meaning 
and sentences, particularly from the syntactical psycholin- 
guistic point of vievj* This approach with its **meaningless 
word form pools", 'Semantic key sorts" "cognitive mixers," 
etc*, seems to me most fruitful if only because meaning or 
concep':ualizing is theoretically distinguished from (and re- 
lated to) words, syntax, etc. But though Osgood explores 
cognition, semantics and linguistics he is not concerned with 
distinguishing between auditory and visual symbol systems - 
(except to say very briefly once or ti'^ice we do not speak the 
way we write, a factor which I consider may be an artefact of 
repeated polishing)* 

The essence of Osgood's thesis as I intepret it is that 
during the encoding of an assertion, non-word menaings selec- 
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tively determine, on a probabilistic basis, the ^choice” of 
words and their positional sequence. However it is difficult 
to determine if Osgood considers abstract conceptual though^ 
possible in the absence of internalized signs or 83 rmbols. 

Inhelder and Piaget (1958) seem to be of the opinion that 
logical thought processes are not founded in verbal symbols 
or linguistic material. 

Before going on to the part played by association I would 
like to emphasise that in the interests of clarity and brevity 
I have here vastly over-simplified both my mm conceptualizing 
of theihole topic and the neuropsychology involved. Like 
many other people I consider that the sensory-neurological 
**workings” of the brain most likely operate on a basis of a 
stochastic selection of bits of stored information of any and 
all kinds and of matching, integrating, decoding and encoding 
them meaningfully. Visual and auditory imagery may even be 
stored in operationally different memory systems (Bannatyne, 

1966) thefomer perhaps being a "spot" or bit matching process 
whereas th<P latter may be a more gestalt-unit sort of regis- 
tration. This would explain some of the real problems a few 
dyslexic children have matching a well learned auditory/vocal 
language to or from its visual/written version. It also fits 
in with Osgood *s contention that the word is the base unit of 
language and by Implication the concept the base unit of thought. 
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1»1NRING. REASONING AND LANGUAGE 

Although language is not thinking it is a symbolic medium 
for facilitating, expressing or communicating thought, and it 
does so with varying degrees of accuracy. Sometimes, for 
example, when speaking at speed I choose a word to express a 
concept even though' I know it is not an exact match. Never- 
theless since language, or more precisely words, phrases and 
sentences, rougilily mirror thought processes it is possible (as 
the symbolic logicians have done) to use them to study the 
nature of thinking. As thinking (i.e. conceptualizing and 
reasoning) cannot occur in a vacuum - we have to think about 
something - the total process Involves one or more of the 
following: (a) actual sensory ‘external ‘objects (the x^atch 

repairer situation); (b) the internal images of those objects 
(the artist x^ho paints from memory or composer whose memory 
imagery is auditory; or the choreographer x^hose memory imagery 
is partially kinaesthetic) ; (c) primary auditory symbols (speak- 
ing and listening); or (d) secondary visual symbols (reading 
and writing). All these, usually in various continuously 
shifting permutations and combinations, participate in think- 
ing and reasoning, but only (a) and (b) can be the subject 
matter x^hich is the content of the thinking. The thinking 
and reasoning aspect is a process of internally manipulating 
this content and the term manipulating , is used because when 
actual objects, as in (a), are represented as an immediate 











Alex Bannatynei Ph.D», Page 11 

concept/content they are often manipulated by the hands usually 
using tools (hassaers, trucks, radar, etc.) at the bidding of 
thought /reason. Apart from the image /concept content what extra 
then does thought /reason have which Internally manipulates 
these? The answer Is, relationships In space » time Involving 
active change wrought by some physical or biological agent or 
agents In the widest sense of those words. Note, that the 
active-change* may be zero because 'statlclty* Is one extreme 
end the change continuum. These changing space- time re- 
lationships of external objects (or the Internal equivalents 
of the latter namely Images, percepts, concepts), when pro- 
cessed by the human brain are thinking and reasoning. Even 
the assertion, *I sse happy* denotes a certain endocrinological 
ego-environment homeostasis, an Interactional continuing space- 
time relationship* 

These Internalized relational elements between image 
type concepts are actively utilized In the neural thought 
processes so that the human organism can postulate trial 
manipulative *runs* of the image /concept -data without having 
to deal with or handle the objects themselves. It Is not too 
much to suggest that thinking and reasoning evolved because there 
was (and Is) an Immense survival value In the organism being 
able neurologlcally to (symbolically and sometimes 

abstractly) actual or possible or even hypothetical series of 
Interrelated events without the acutal events occurlng, or 
without the objects themselves being present. A definition 
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of thou^t In those terms would be the dynamic (neurological) 
manipulation of Internalized models and their Interrelitlon- 
ship structures » all of which attempt more or less to simulate 
reality (e«g« planning a road system or even an abstract paint* 
ing). 

These thinking and reasoning relationship manipulations 
are the key to the nature and structure of all meaningful 
language as symbol systems. In fact, I am of the opinion 
that morphemes, words, phrases, sentences, and from another 
angle, syntax are no more or less than auditory or visual 
labels strung together as the communicative matching eoul * 
valents for pute sensory-origlnated (In the past) Image concepts 
and their direct Interrelationships. The communicative aspect 
may be Internally facllltatvle or externally transmitting or 
both. 

Summarizing the above discussion, we can say that firstly, 
thou^t Is the fundamental reason for the existence of language, 
secondly, that thought Is not language In the 'word-sentence* 
sense of the term, thirdly that as well as concepts, an essential 
part of thinking Is to be found In the manipulative relational 
elements between concepts, fourthly, that these relational 
factors have reality In space-time changes, fifthly, that they 
can exist as Internalised dynamic (or passive-observational) 
models which can be manipulated hypothetically. But most 
important of all these relational elements themselves can be . 
symbolized (or represented) on the verbal word level, and 
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moreover these verbal equivalents of apace/tlme relationships 
only become truly meaningful when they interconnect concepts. 

Thus 9 for example (a) I can actually look at a bush between 
two trees, (b) I can plctorlally imagine a bush between two 
trees, and (c) I can sav or write . **A bush between two trees.” 

If we add the movement-change relation to the mix, usually in 
the form of a verb, (d) I can say, ”A bush is standing betgj>e.en 
two trees.” The complete relationship of bush and trees is 
<1) in the present time (2) standing (paradoxically a static 
motion) and (3) between , l.e. spatially in the center! Similar 
analyses can be made for auditory, kinesthetic /mo tor, tactile, 
visceral images or any other kinds of Imagery including mixtures 
of these. Even abstraction in this context, is a psychological 
image-concept phenomenon, essentially non-verbal in nature, 
which may sometimes be represented verbally. 

Unf ortunatley there is no space in this paper to elaborate 
further these aspects of thinking or the parallel symboli- 
zation process, language. Much of the above section has stressed 
the association of Image/concept with language symbols partic- 
ularly the auditory symbolic system. There is a need to clarify 
further the association processes between image /concepts, their 
auditory symbolic system and the visual symbolic system. 



MEANINS TO SOUND-LABEL ASSOCIATION 



One point needs to be made clearly. Syntax or the sequence 
of auditory symbol-labels is almost completely determined by the 
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interrelationship determinants linking purely non-verbal image/ 
concepts* Image /concepts as internalized *thlngs* are action- 



manipulated in space-time, selectively qualified with intrinsic 
attributes and quantified by relative evaluations, and it is 
the sequence of these factors which determines syntax. 



e*g, 



The heavy 
quantity 



I 



man 

thing 



ate 

action 



the brown! bread 

I 

qualify ! thing 



If one asks why the sequence sirf>ject-verb-object (or its ling- 



uistic equivalent) occurs, the only answers are first, that 
this is the visual temporal sequence of the event in terms of 
their cause -and- effect importance to the speaker, e.g, *'The 
heavy man caused to be consumed the brown bread.** The contin- 
uing conversation is probably centered around the heavy man 
and his diet. The first 'thing* mentioned is usually the most 
important from the -stage -setting* point of view, e.g, in the 
sentence, *The brovm bread was eaten by the heavy man”, the 
speaker no doubt feels the bread was- most Important and the 
continuing conversation is probably centered around the bread. 
It is worth noting that habitual thought sequences develop 
cliche-like habitual word sequences e.g, ***»7hat is for dinner 
tonight dear?” These can be automatically processed at speed. 
However original or strange thou^ts (or when listening, words) 
may be very hesitantly processed. (Goldman Eisler 1964)# The 
above discussion has elaborated the relationship of syntac- 
tical sequencing to meaning sequences. The image/concept to 
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sound-label association has been described earlier in the paper. 
There remains the auditory to visual symbol system association 

to clarify. 

AlTDTTQRY LABEL-VISUAL LABEL A SSOCIATIONS' 

Teaching children to read has led me to the conclusion 
that they learn to associate sound-labels with visual labels 
(and vice versa) on both a gestalt whole-word basis and on a 
phoneme-grapheme analytic -synthetic basis. Of course there will 
be a bias in keeping with the method used to teach the child 
to read but children taught to look-and-say will eventually 
develop a somewhat crude phoneme analysis and blending attack 
to use on new or difficult words. Although children taugjit 
through phonics analyse most words, there are some words with 
distinctive visual patterns which they seem to recognize im- 
mediately as a gestalt. Host research tends to indicate that 
a combined method with a slight emphasis on phonics is the 
most efficient technique for teaching reading. The three- 
quarters of school entry children who are verbally competent 
will rapidly learn to read by any method and often in spite of 
the teacher J Seriously though I often wonder if all the 
intense discussions on global reading methods are worth the, 
at best, marginal differences claimed for them. 

However the least competent quarter of beginner readers, 
together with the severe reading disability cases are quite a 
different educational proposition. Slight differences in 
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teaching techniques or sensory training may bring about startling 
differences in attainment. The matching of specific remedial 
methods to specific deficits has bcendealt with in another paper 
(Bannatyne, 1967) and I will not repeat myself here. Instead, 

I will briefly outline the associative processes involved in 
decoding (reading) or encoding (spelling and writing) from the 
auditory“Visual point of view, i.e. taking the 'meaning* for 
granted. The child has to turn the gestalt of letters into 
sounds, or the gestalt of sound into letters. Most of us as 
competent adult readers can do this instantly either way but the 
beginner or poor reader who cannot recognize or spell a particular 
word has to cope with it with an analytic attack of some kind. 
Content may provide some clues but often there is insufficient 
evidence for even a reasonable guess. 



I 



irregular orthography 

The phoneme -grapheme matching (orthography) system in 
English is notoriously irregular in both decoding and encoding. 
(Here decoding referes to decoding the visual graphemes into 
auditory phonemes, and encoding to 'translating* the auditory 
phonemes into visual graphemes. The fact that there are two 
stages or sets of both decoding and encoding in reading and 
spelling is never mentioned or made clear by most writers.) 
Because grapheme -phoneme orthography is so irregular , each paired 
association as it appears in each word has to be learned by 
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rote memory in association with the only distinctive feature of 
that word namely its meaning* in- context* The dog is a bow-wow, 
the knights hav to the Queen; the archer aims his bow; the 
boudi is on the tree. The girl ties her hair with a b£W because 

her beau is coming to meet her. 

The phoneme-grapheme rote memory association (within a 
single ‘content-meaning*) is extremely difficult to establish 
in most severe reading disability cases. Even more difficult 
to Ingrain is the rapid automatic sequencing of these assoc- 
iations, xflhich after all is what reading or spelling is. In 
investigating this disability I have come to the conclusion 
that themajor problem for most of these children lies in their 
poor ability to identify auditory-phonemes and in the sequencing 
(blending) aspects of the phoneme -grapheme association. (There 
are quite a fe \7 children with disturbances of the visual areas 
of the brain but Frostig (1963) and others have thoroughly 
investigated them and their difficulties arc not pertinent 

here.) 

AUDITORY DISCRIMINATION OF PHONEtiSS 

Usually children do not need to hear the separate phonemes 
within a word when they hear or speak them in normal conver- 
sation. No doubt to some extent the economies of the neur- 
ological computer do demand *bit* storage of sounds possibly 
in two separate places, one for listening and one for speaking. 
This process is largely automatic and the sequences of ’bits* 
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become to all intents and purposes gestalts of sound vihlch are 
near enough to their ideal phonetic equivalent. Because many 
reading disability boys do not listen accurately, their regis- 
tration and production of words may be somewhat distorted, 
(slurred, phonetically inaccurate, etc.). In the course of 
normal conversation the auditory closure of other people 
(closure copes x^ith accent variations, etc.) x7ho are listening 
makes appropriate allox/ances for these mispronunciations so 
they do not matter. However in reading and spelling they can be 
a distinct handicap because the distortion of phonemes creates 
even more chaos and irregularity with grapheme processing. 

When spelling we internally sequence the phonemes and transpose 
them into graphemes. If (a) the phonemes are distorted, 

(b) phoneme -grapheme correspondence is inherently irregular 
and (c) the phonemes are auditorially unseparated in an *out- 
burst* of sound, then the grapheme (and hence letter) sequenc- 
ing output on paper will be equally chaotic. Likewise in reading 
even if the poor r-- Jer with these three handicaps was able to 
split up words into purely visual grapheme segments, the de- 
coding of them into their respective sequence of correct phonemes 
(which would then be blended into gestalts of sound) would be 
equally chaotic. This in fact is just what does seem to happen 
even though on test there is nothing wrong with the hearing or 
brains of these children. 

Therefore, I advocate that in those reading disability 
cases whose vision and motor integration processes are neur- 
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ologlcally intact one should ecobark on an intensive training 
program vhlch emphasizes listening to words and identifying 
phonemes, clear phoneme articulation as in elocution, the 
correct blending of phonemes in speech, the permutations and 
combinations of phoneme -grapheme memory associations learnt 
by rote (encoding and decoding), increased auditory closure 
from the child *s own mispronunciations of *sounded* words, and 
the identification of ambiguous graphemes /phonemes from the 
context of the sentence. Furthermore, if these children are 
taught to spell and write words and then sentenceTj , they 
will automatically learn to read because the encoding process 
involves the recall of phoneme -grapheme equivalents^ out of the 
blue» without the aid of the visually recognized stimulus of the 
printed word. Hoxjever any visual devices such as small letter 
cards or grapheme cards which facilitate correct sequencing 
are very much in order. 



CONCLUDING REI1:\RICS 

This paper has surveyed the field of language learning 
in some of its aspects only very sketchily and much support- 
ing argument and evidence has had to be deleted. If a slender 
case has been made for the importance of auditory factors in 
reading it will have served its purpose. Illiteracy is largely 
the result of legally requiring aJl children to reach a high 
level of attainment. If this was done for music many of us 
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AbiliticG, and Reading.'* 

Paper read at the I.R.A. Congress, 
Paris, France, June. (Published 
Proceedings, I.R.A.) 



to Specific Deficits." 

Paper read at the International 
Convocation on Children with Learn 
ing Disabilities, Pittsburgh, Feb- 
ruary. Tlie Home for Crippled 
Children. (To be published.) 



Brain-injured Child.** 

American Journal of Orthopsy- 
chiatry. Vol. 33/34, 565-671. 



Directions in the Study of Lang- 
uage" by ?1. H. Lenneberg (Editor). 
The M.I.T. Press, Carabridge, Hass. 



might be found 'musically dysle||ic'« Af tei; .-all^ until rec 
ently almost all language was expressed vocally. 
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